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Abstract 

This paper aims to theoretically prove by applying Marotto’s Theorem that both transiently 
chaotic neural networks (TCNN) and discrete-time recurrent neural networks (DRNN) have 
chaotic structure. A signihcant property of TCNN and DRNN is that they have only one hxed 
point, when absolute values of the self-feedback connection weights in TCNN and the difference 
time in DRNN are sufficiently large. We show that this unique fixed point can actually evolve 
into a snap-back repeller which generates chaotic structure, if several conditions are satished. 
On the other hand, by using the Lyapunov functions, we also derive sufficient conditions on 
asymptotical stability for symmetrical versions of both TCNN and DRNN, under which TCNN 
and DRNN asymptotically converge to a fixed point. Furthermore, generic bifurcations are 
also considered in this paper. Since both of TCNN and DRNN are not special but simple and 
general, the obtained theoretical results hold for a wide class of discrete-time neural networks. 
To demonstrate the theoretical results of this paper better, several numerical simulations are 
provided as illustrating examples. 

Keywords- Neural network. Chaos, Snap back repeller. Simulated annealing. Asymptotical 
stability. 
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output of neuron i 

internal state of neuron i 

connection weight from neuron j to neuron i 

input bias of neuron i 

damping factor of nerve membrane 

self-feedback connection weight 

connection weight matrix 

steepness parameter of output function(e > 0) 

Lyapunov function 

time step of the Euler method 

damping factor for Uu 

eigenvalues of matrix 

the smallest eigenvalue of matrix W 

the largest eigenvalue of matrix W 

self-recurrent bias 

the composition of F with itself t times 
the Jacobian matrix of F at the point Y G 
determinant of Fy(Y) 

closed ball in i?” of radius r centered at the point Y 

interior of B{Y] r) 

transpose of the column vector Y 

the usual Euclidean norm of a vector or the induced matrix norm of a matrix 

= (0,...,0f 
= If 
the identity matrix 

region dehned as S' = {(xi,a;n)|0 < a;* < 1; i = 1,n} 

vertices dehned as Sy = {{xi, ...,Xn)\xi = 0 or 

internal points dehned as Si = {(xi, Xn)\^ < x* < 1;i = 1,n} 

boundary points dehned as Sb = S — Si — Sy 

X is directly proportional to y 

the n X n zero matrix 
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1 Introduction 


Up to now, artificial neural networks (e.g. Amari, 1972, Hopfield, 1982; Hopfield Sz Tank, 1985; 
Rumelhart, et al., 1986; Wells, 1992; Peterson & Anderson, 1989; Peterson & Soderberg, 1993) 
have been widely applied to various information processing problems with considerable success. 
In particular, the transiently chaotic neural networks (TCNN) with chaotic simulated annealing 
(CSA) have been shown to be a promising tool for combinatorial optimization Since 

TCNN has rich dynamics with various coexisting attractors, not only of hxed points but also 
periodic and even chaotic attractors, it can be expected to have high ability of escaping from 
local minima and searching for globally optimal or near-optimal solutions. However, although 
it has numerically been observed that the numerical chaos with positive Lyapunov exponents 
exists in TCNN when the temperature, or the self-feedback connection weight is sufficiently 
large, it has not yet theoretically been proved that TCNN does have chaotic structure. 

On the other hand, there are a variety of mathematical dehnitions of chaos, such as geo¬ 
metrically constructed chaos (or geometric chaos) including Horseshoe, Solenoid, and Plykin 
systems, formal chaos (or topological chaos) with positive topological entropy where shift map¬ 
ping is included as a subsystem, and numerical chaos in which the maximal Lyapunov exponent 


is numerically observed to be positive, and so on [|Ig. The dehnition of chaos widely used in 
discrete-time dynamical systems is the Li-York chaos which was proposed by Li and York and 
which actually corresponds to topological chaos |T^. In 1975, Li and York derived a surpris¬ 
ingly simple condition ensuring the existence of chaos in one-dimension systems, that is, ” Period 
three implies chaos” |^. In 1978, Marotto extended the Li-York’s work to multi-dimensional 
systems by dehning snap-back repellers, that is, ” Snap-back repellers imply chaos in i?"” . 

In 1979, Shiraiwa and Kurata further generalized the theorem of Marotto to include not only 
repellers but also saddle points [^. Shiraiwa and Kurata also showed that their theorem was 
a generalization of Smale’s results on transversal homoclinic points in some sense. 

On chaos in discrete-time systems obtained by temporally discretizing continuous-time sys¬ 
tems, in 1979 Yamaguti and Matano proved that there exists chaotic structure in some class 
of one-dimensional difference equations with two hxed points when the difference time is suffi¬ 
ciently large, by using Li-York’s Theorem [^. In 1982, Hata extended the works of Yamaguti 
and Matano to multi-dimensional difference equations with two hxed points, by using Marotto’s 


Theorem [10|. In 1983, Ushio and Hirai further showed that there exists chaotic behavior in 
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nonlinear sampled-data control systems with two fixed points when the sampling period is 
snfficiently large |^, by using Marotto’s Theorem and Shiraiwa-Kurata’s Theorem. 

Motivated by the previous works, this paper aims to theoretically prove that both TCNN 
and more general discrete-time recurrent neural networks (DRNN) have chaotic structure by 
applying Marotto’s Theorem. A significant property of TCNN and DRNN is that they have 
only one fixed point, when absolute values of the self-feedback connection weights in TCNN and 
the difference time in DRNN are sufficiently large. We show that this unique fixed point can 
actually evolve into a snap-back repeller which generates chaotic structure, if several conditions 
are satisfied. 

For the aspects of asymptotical stability, on the other hand, a number of progresses have been 
made for continuous-time neural networks. For instance, it has been proven that continuous¬ 
time neural networks with symmetrical connections always converge to a fixed point [|T^, |T^ . 
However, theoretical results of continuous-time neural networks do not necessarily hold for 
discrete-time neural networks with continuous-states because analysis of discrete-time neural 
networks, which also depends on the updating schemes such as synchronous updating and asyn¬ 
chronous updating, is quite different from that of continuous-time neural networks. For some 
special forms of discrete-time neural networks with continuous-states which are widely used in 
the analysis of mean field equations |^, Marcus and Westervelt indicated in 1989 that there 


exist only stable fixed points and stable period-two cycles [^. Although it has numerically 
been observed that TCNN with CSA converges to a fixed point attractor if the absolute value of 
self-connections is sufficient small, it remains theoretically unclear what conditions are sufficient 
for the convergence and which fixed points are asymptotically stable in TCNN. 

In this paper, we also aim to analyse discrete-time neural networks of both TCNN and 
DRNN, and to investigate the asymptotical stability as well as the relations between fixed 
points and local minima of the Lyapunov functions. In other words, by using Lyapunov func¬ 
tions, we derive sufficient conditions on asymptotical stability for several symmetrical versions 
of both TCNN and DRNN, under which these networks asymptotically converge to a fixed 
point. We show that the convergent properties of discrete-time recurrent neural networks are 
quite different from those of continuous-time recurrent neural networks although many of them 
are similar in terms of asymptotical stability and locations of fixed points. Furthermore, the 
relationships between the asymptotically stable points and the minima of the Lyapunov func¬ 
tions are also investigated for both asynchronously and synchronously updating schemes, by 
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which TCNN and DRNN can be applied to combinatorial optimization problems. In addition, 
we also give conditions of generic bifnrcations, i.e., the fold and flip bifnrcations, and explain 
the bifnrcation structnre of chaotic simnlated annealing. Since both of TCNN and DRNN 
are not special bnt simple and general, the obtained theoretical resnlts hold for a wide class 
of discrete-time nenral networks. To demonstrate the theoretical results of this paper better, 
several numerical simulations are provided as illustrating examples.! 

This paper is organized as follows: In the next section, Marotto’s Theorem and several 
definitions are briefly described. In section three, we hrst give a general form of TCNN and then 
prove convergence theorems for several symmetrical versions of TCNN. In addition, bifurcation 
conditions for flip and fold bifurcations are also given in section three. We show that all of the 
theoretical results in section three also hold for chaotic neural networks (CNN) |^. Section four 
describes one theorem for the existence of a fixed point in TCNN with the sufficiently large 
absolute values of self-feedback connection weights, and gives sufficient conditions for chaos 
in TCNN. Asymptotical stability conditions and the proof of existence of chaos in DRNN are 
given in section five and six, respectively. Finally, we give some general remarks to conclude 
this paper. 
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2 Notation and Marotto’s Theorem 


We use the following notation, similar to that of Marotto throughout the paper. Let us 
dehne a discrete-time system as, 


Y{t+l)=F{Y{t)) (1) 

where, Y{t) e {t = 1, 2,...) and F e ^ RT . 

Let F^ denote the composition of F with itself t times, then a point F is a p-periodic 
point if FP{Y) = Y but F\Y) ^ F for 1 < f < p. If p = 1, that is, F{Y) = F, F is 
called a hxed point. Let FyiY) and det{FY{Y)) be the Jacobian matrix of F at the point 
F G R^ and its determinant, respectively. Let B{Y;r) be a closed ball in R^ of radius 
r centered at the point F, and B^(Y;r) its interior. Furthermore, let F^ be the transpose 
of the column vector F. Dehne || ■ || to be the usual Euclidean norm of a vector or the 
induced matrix norm of a matrix. Dehne Eo = (0,..., 0)^, = (1,...,!)^, and 1 to be 

the identity matrix . Dehne the region S = {(xi,...,x„)|0 < Xj < l;i = l,...,n}. Then 
S can be divided into vertices Sy = {(xi,...,x„)|xi = 0 or = l,...,n}, internal points 
Si = {(xi,..., x„)|0 < Xj < 1; i = 1,..., n} and boundary points Sb = S — Sj — Sy, respectively. 
X oc p means that x is directly proportional to y. 0 is the n x n zero matrix. A small letter 
stands for a scalar, and a capital letter represents a vector, a matrix or a set in this paper. 

Definition 2.1 (Marotto, 1978) A fixed point Y* is said to be a snap-back repeller of eqn. 
if there exists a real number r (> 0) and F° G B{Y*;r) with F° ^ Y* such that all eigenvalues of 
Fy{Y) exceed the unity in norm for all Y G B{Y*]r) and F'^iY^) = Y* with det{FY(Y^)) ^ 0 
for some positive integer m. 

Theorem 2.1 (Marotto, 1978) If eqn. & has a snap-back repeller then the system of eqn. & 
is chaotic. In other words, there exist, 

1. a positive integer n such that for each integer p > n, eqn. & has p—periodic points; 

2. a scrambled set, i.e, an uncountable set L containing no periodic points such that 


(a) F{L) C L 

(b) for every Y E L and any periodic point X of eqn. 
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(c) for every X,Y E L with X ; 


limsup||F*(F) -F*(X)|| > 0 

t—>oo 

3. an uncountable subset Lq of L such that for every X,Y E Lq 


liminf||F*(F) -F‘(X)|| = 0 

t—>oo 
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3 Asymptotical Stability and Local Bifurcations of Transiently Chaotic 
Neural Networks 

In this section, first the transiently chaotic neural network (TCNN) is briefly summarized. 
Then, several convergence theorems for symmetrical versions of TCNN are derived. Besides, 
the relations between asymptotically stable points of TCNN and local minimal points of the 
Lyapunov function are also investigated. 

3.1 A model of the transiently chaotic neural network 

The model of the transiently chaotic neural network (TCNN) can be described in terms of 
scalar variables as follows i, 11,1: 



(2) 

yi{t -h 1) = kyi{t) + +ai- O 0 ii{t)aoi 

i=i 

\u;ii{t+ 1)1 = {1 - I3)\u;ii{t)\ 

(3) 

(4) 

{i = 1, ...,n) 



where, uju = uiuit) is a variable depending on eqn.(|D and all variables and parameters are 

real numbers, and 

Xi : output of neuron i 

Hi ; internal state of neuron i 

ujij : connection weight from neuron j to neuron i 

tti : input bias of neuron i 

k ; damping factor of nerve membrane 

e : steepness parameter of the output function (€>0) 

ujii : self-feedback connection weight, where uJu = uJuit) 

{3 : damping factor of the time-dependent unit) (0 < /3 < 1) 

aoi : self-recurrent bias of neuron i. 

Since we investigate sufficient conditions of chaos and asymptotical stability for TCNN with 
temporally constant cou, uJu is hxed by dropping eqn.(||) in the following analysis.Therefore, 
TCNN can be rewritten in terms of vector variables as follows. 


Y{t + 1) = F{Y{t)) = kY{t) + WX{Y{t)) + / - ...,a;„„)/o (5) 


where, diagiuu, ...,ujnn) is a diagonal matrix and 
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Y{t) = 


yiit) 

Vnit) 


, X{Y{t)) = 


Xi{t) 

Xn(t) 


l-i-e-yiW/c 


1 

. lJ^e-yn(t)/e _ 


I = 

ai 

) -^0 — 

flol 

, w = 

uJn <^12 • 

1^21 1^22 

^In 

• <^2n 


dn 


OlOn 


^nl ^n2 

^nn 


Obviously, F in eqn.(H) is a class function for any bounded Y. Besides, F can be 
viewed as an iterated map or a difference equation or a neural network with discrete-time and 
continuous-state. If Iq = Eq, eqn.(|D coincides with chaotic neural networks (CNN) ii- 
To analyse the asymptotical stability of X{t), we rewrite eqn.(^) by explicitly expressing 


X(t + 1) = F(A'(()) = 

where, 0 < Xi(t) < 1 for i = 1, 




1+e 


“ e +S"=1 '^nj^jW + an-<^nnaOri] 


L 1+e 


( 6 ) 


3.2 Asymptotical stability for TCNN 

Next, we hrst show several convergent theorems for eqn.(^, which ensure that the system of 
eqn.(P) asymptotically converges to a stable hxed point, and then derive locally stable conditions 
by analysing the eigenvalues of the Jacobian matrix. Let us dehne two updating schemes, i.e., 
synchronously updating and asynchronously updating. In synchronously updating, all neurons 
are updated in parallel, using only old values as input. In asynchronously updating, neurons 
are updated one by one, using fresh values of previously updated neurons Generally, 

asynchronously updating can further be divided into random-order asynchronously updating 
where neurons are chosen in random order, and hxed-order asynchronously updating where 
neurons are chosen in hxed-order, e.g., cyclic updating. In this paper, asynchronously updating 
means both random-order and hxed-order asynchronously updating. 

Let Xmin, Xmax be the smallest eigenvalue and the largest eigenvalue of the matrix W, re¬ 
spectively. Dehne 
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1 n n n ^ 

f{X) = --^uJijXiXj - + ai)xi - {k-l)eJ2 / ln——dx 

^ ij i ^ Jo I X 


(7) 

R is 


Note that YU fo* In-^dx = + (1 “ Xi)ln{l — Xi)]. Obviously, f{X) : R!^ 

bounded for all 0 < Xj < 1 (z = 1, n). 

Theorem 3.1 Assume W = , and 

1. 1/3 > fc > 0, 4(1 - k)e > -Xmin 
or 

2. 1 > /c > 1/3, 8/ce > —Xmin 
or 

3. k>l, 8e> -Xmin- 

Then X(t) of the discrete-time system eqn. & asymptotically converges to a fixed point, as far 
as eqn. w is synchronously updated. 


Proof of Theorem p.lj . We use the direct approach based on a Lyapunov function, to 
prove the Theorem. 

For condition 1: Consider the change in / between two discrete time steps under the as¬ 
sumption of synchronously updating. 


\ ^ x (t-\-l) x (t) 

fiXit + 1)) - fiXit)) = --Y^uJi,Ax,Ax, - keY^Axifn ^ / -In ’ 

a i I Xi[t+i) 


1 - Xi{t) 


” rxi(t+i) ^ 

-(1 - /,) + (1 - ( 8 ) 


1 ^ ^ 

- “ (1 “ k)eYJXxilnz 


rXi{t+l) jf. 

— In - dx] (9) 

1 — Xi{t + 1) Jxi{t) 1 — X 

where, Axi = xfit + 1) — xfif). In eqn.(|D, eqn.(|D is substituted. Since In-^ is a (strictly) 
monotonously increasing function for 1 > x > 0, -keAxifn-fff^^^r^ — < 0 which is 

used to derive eqn.(P). Furthermore, we get the following equations by expanding In-^dx 
at Xi{t + 1), 





In - dx 

1 — X 


_ Mt + i) 

Jo 1-x 1-Xi(t + 1) 


+ 


[Axi 


rxi(t+l) X , . , xAt + 1) 

> / In - dx — Axiln ---- 

-Jo 1-x 1-Xi(f + 1) 


1 

(10) 

TiO- - Ti) 

- -\- 2[Axj] 

(11) 
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where, ipi is between Xi{t) and Xi{t + 1), and ^ = 4 for 0 < < 1 is used in 

eqn. O- Hence the following inequality holds. 


rxi{t+l) 


In- 


X 


-dx < Axdn 


J Xi{t) 1 — X 

Therefore for 1 > A; > 0, because of eqn.(|^, 


Xi{t + 1) 

'1 - Xi{t + 1) 


— 2[Axi 


( 12 ) 


1 n 1 

f{X{t+l))-f{X{t)) < --J2[u;,j+46,,{l-k)e]Ax,Ax, = --AX{tf[W + 4{l-k)e l]AX{t) 

ij 

(13) 

where AX{t) = X(t + 1) — X(t); 6ij = 1 for i = j and 6ij = 0 otherwise. 

From the assumption of this theorem, the matrix W + 4(1 — k)e 1 is positive dehnite. 
Hence, + 1) — f{t) < 0, where equality holds only for AX{t) = 0, which means that X{t) 
has reached a hxed point of the network dynamics. Note that since IF is a symmetry matrix, 
all the eigenvalues of W are real numbers, i.e., Xmin C R. 

For condition 2 : We use a different approximation scheme to derive condition 2. We 
rearrange eqn.(|^) as follows: 


f{X{t + l))-f{X{t)) = 


A A ^ A r/ Xi{t + 1) Xi{t) . 

-- > (JijAxiAXn — e > Axi\ln -^-- — In -^ 


-il-k)eJ2Axiln J +(l-fc)e^ 

1 ^ A A ^ A r/ + 1) ; 1 

= — > (JuAxiAxi — e > Axi\ln -^-- — In -^ 

2^ i i-Xi{t + i) i-Xi{ty 

+ {1 — k)ey^ Axi\ln ^ — ln _^ (15) 


1-6 


1 - Xi{t)^ 


where, = Xi(t) + OiAxt; 1 > 6 > 0, and Axt = Xi(t + 1) — Xi(t). The mean value theorem 
is applied in eqn. ( 0 ). 

Since is a monotonously increasing function for 1 > a; > 0 and is between Xi{t) and 

Xi{t + 1), In ~ /nfake the same sign. Furthermore, 


I, Xi{t + l) Xi{t) y 

\Ln - - -r — In -^1 > \ln 


1-Xi{t+1) 1-Xi{t) 


1-6 


-iri- -^ ;(? = l,...,n) 

1 - Xi{t) 


(16) 


Therefore for 1 > A: > 0, because of eqn.(^) and the monotonously increasing function 


In 


1 — X ’ 
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/(X(t + l))-/(X(t))< 


2 n n 

— '^uJijAxiAxj — ^ Axike[ln 

ij i 


Xjjt + 1) 

1 - Xi{t + 1) 


— In 


Xjjt) 

1 - Xi{t) 


in n K 

2 « T ’(i(l - O 

< - Ax{tY\W + sk( l]AA'(i) < 0 


(17) 

(18) 
(19) 


where rji is between Xi{t) and Xi(t + 1). In eqn.(^),eqn.(|^ and condition 2 are used. 
The mean value theorem is applied in eqn. (p!8[) again, and min ^ ^ = 4 for 0 < p* < 1 is 
substituted in eqn.([I^). The equality holds only for AX(t) = 0, which means that X(t) has 
reached a hxed point of the network dynamics. 

For condition 3: From eqn. (|T^) , 


f(X(t + 1)) - f(X(t)) < 

1 " ” el 

= n _ —1 + 8^ l]AX(t) < 0 (21) 

^ ij i Vi\^ Vi) ^ 

where in eqn.(^), eqn.(|^) and k > 1 are used. The equality holds only for AX{t) = 0. 
Therefore, f{X) is a Lyapunov function for eqn.(|^), which indicates that X{t) of the system 
asymptotically converges to a hxed point. □ 

Marcus and Westervelt derived the condition 1 for k = 0. Therefore, Theorem 0 can 
be viewed as a generalization of the Marcus and Westervelt’s result. 

Remark 3.1 Assume W = W'^. According to the Gerschgorin Theorem (see Appendix^), 

1. z/0 <k< 1/3; ctijj +4(1 —/c)e > | fori = 1, ...,n, then the matrix W + 4(1 —/c)e 1 

is positive definite; 

2. if 1/3 < k <1; uJu + Ske > \ fori = 1, then the matrix W + 8fce 1 is positive 

definite; 

3. i/1 < k; uJii + Se > \ fori = 1, then the matrix IF + 8e 1 is positive definite. 

These show that the system of X{t) is asymptotically stable. 


Theorem 3.2 Assume W = , and 
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1. 1/3 > A; > 0, 4(1 — k)e > — min^^^uju 
or 

2. 1 > A; > 1/3, 8A;e > — minf^iUa 
or 

3. A: > 1, 8e > — min^^iUJu. 

Then X{t) of the discrete-time system eqn. §) asymptotically converges to a fixed point, as far 
as eqn. is asynchronously updated. 


Proof of Theorem |3.2| . Without loss of generality, let neuron-/ be the updated neuron 
at iteration-(/ -I- 1), then the change in / dehned by eqn.(|^) due to this updating is, 


f{xi(t + 1)) - f{xi{t)) = ~uii[Xxif - keXxi[ln ^ ^-^xfit) ^ 

Ti(f -l- 1 1 /*^/(^+l) 7* 

-(1 - k)eAxiln , + (1 - k)e / In-^dx (22) 

^ ^ 1-Xi{t+1) ^ ^ Jxtit) 1-x ^ ^ 

Then, as the same way as the proof of Theorem |3.1|, we can prove this theorem by showing 

that f{X) is also a Lyapunov function of eqn.(|^) with an asynchronously updating scheme. □ 

Remark 3.2 Assume W = W'^. If k = 0, the attractors of eqn. for both synchronously 
and asynchronously updating, are only fixed points and 2-periodic points (Marcus & Westervelt, 
1989) regardless of any value of uiij {i,j = l,...,n). 

This fact can be easily shown by use of the results of Marcus and Westervelt (1989). 

A state Xg is said to be a stationary point of f{X) if satisfying = 0. Therefore, 

stationary points are composed of local minima where fxx is positive (or semi-positive) 
dehnite, local maxima where fxx is negative (or semi-negative) dehnite, and saddle points 
where fxx is indehnite. It should be noticed that local minima for f{X) subject to Eq < X < 
El include the local minima on stationary points of f{X), and local minima on the boundary 
points or vertices of X which may not belong to stationary points of f{X). 

Lemma 3.1 Assume W = W'^. 

1. Fixed points of eqn. §) are composed of all stationary points of f{X) (i.e., local minima, 
local maxima and saddle points of f{X(t))) and all of the vertices of X{t), regardless of 
synchronous or asynchronous updating. 
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2. As far as k ^ 1, there is no stationary points of f{X) on the vertices or boundary points 
ofX. 

Proof of Lemma |3.1| . 

From the definition of Xi{yi{t)) of eqn.(|^) and the mean value theorem, 


Xi{yi{t + 1)) - Xi{yi{t)) = [yi{t + 1) - yi{t)] 


Pi{l-Pi) df{X{t)) pi{l- Pi) 


(23) 


e dxi{t) e 

where, pi is between Xiit) and Xi{t +1). In eqn. (|^) , eqns.(|[) and are used. 

For Lemma |3. J| -J ; Since Fq < X{t) < Ei, from eqn.(^3|), fixed points of X{t) obviously 
satisfy 


dfjXjt)) 

dxi{t) 


= 0 for i = 1, ...,n 


or 


Xi{t) = 0 or 1 for z = 1,..., n. 

Therefore, the proof of Lemma p.l[ -l is straightforward. 

For Lemma |3. J| -2 ; The stationary points satisfy 




dxi{t) 


- - (Oj - cniiOoi) = 0 ; z = 1, ...,n. (24) 

t Xi[tj 


If A; 7^ 1, while the second term and the third term on the right hand side in eqn.(p^ are 
bounded, the first term becomes unbounded when x* —0 or 1. This fact proves the Lemma 

^ 2 . □ 


Theorem 3.3 Assume the same conditions as Theorem \3.1\ or Theorem \3. Then a point 
X{t) is asymptotically stable for eqn. & if and only if this point is a local minimum of f{X) 
for Eo < X < El. 


Proof of Theorem p.3| . Assume that there exists a point X* which is an asymptotically 
stable point but not a local minimum of f{X). Then, according to the definition of asymptotical 
stability for discrete-time systems in the sense of Lyapunov [^, for an arbitrary neighbourhood 
U around X*, there exists V C U such that any trajectory with X(0) C V converges to X* 
with t ^ oo. However, since X* is not a local minimum of f{X), there exists X C V satisfying 
f{X) < f{X*). Therefore, when the trajectory starts from X at t = 0, 
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/(X(0)) = f{X) < f{X*) = /(lim X{t)) = lim /(X(t)), 


t—^•oo 


t—>co ' 


(25) 


which implies that the Lyapunov function increases with t. This contradicts Theorem ^ 
Theorem Furthermore, according to Lemma 


or 


any local minimum of f{X) is a hxed 
point of X{t) for eqn.(|^). Therefore, any asymptotically stable point must be a local minimum 
oif{X). 

On the other hand, since any local minimum of f{X) for Eq < X{t) < Ei is a hxed point, 
there exists a neighbourhood U around this local minimum X* such that f{X*) — / = 0 and 
f{X)—f > 0 for X E U and X ^ X*, where / is a bounded constant. Moreover, from Theorem 
O or Theorem ^.21 , f{X{t + l)) — f{X{t)) < 0. Therefore any local minimum is asymptotically 
stable. □ 


Corollary 3.1 Assume the same conditions of Theorem \3.1\ or Theorem \3.^ and assume uju = 0 
for * = 1,...,«, and k = 1, then a point X{t) is asymptotically stable for eqn. & if and only if 
this point is a local minimum of f{X) for Eq < X < Ei on the vertices. 

Proof of Corollary |3.1| . 

Since k = 1 and uu = 0, f{X) dehned in eqn.(^ is a multilinear form which has no local 
minimum belonging to stationary points. In other words, f{X) has no local minimum for 
Eq < X < El except some vertices. Therefore, we get this Corollary from Theorem |3.3| . □ 

Although Theorem p.l| and Theorem p.2| are simple and easy to apply, they are conservative 
estimators for the evaluation of asymptotical stability. Next, we give two more general theorems 
to evaluate the local stability in an exact manner. 

For synchronous updating, dehne the Jacobian matrix Jx of eqn.(|^) at X(t), 




3;i(f+l)[l—a:i(t+l)] 


0 


dX(t) 

Xlit + 1)[1 - Xlit + 1)] 

0 


0 


Xn{t+l)[l-Xn{t+l)] 

Xnit)[l-Xnit)] 


0 

Xn{t+l)[l -Xn{t+l)] 


w. 


(26) 


\i X = [xi, ..., Xn) is an internal hxed point, which means Eq < X < Ei,X{t) = X{t + 1) = 
X, then eqn.(p^) simply becomes. 
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Jx = k 1 + -diag{xi{l - xi), ...,Xn{l - Xn))W, 
or is expressed in terms of fxx, 


Jx = 1- diag{xi{l - Xi),a:„(l - Xn))fxx{X), 

e 


where 


(27) 


(28) 


fxx{X) = -W-{k-l)ediag[- 


^Xi(l - Xi)’ ■■■’ Xn(l - Xn) 

On the other hand, if X is a hxed point on boundary or vertice, for any x* = 0, 


(29) 


lim 


Xjjt + 1) 

Xi(t) 


= lim --- 


1 


iW 




ujijXj (i)+aj —uJaaQi] i 


= lim 

Xi(t)^0 


1 


® ' L ' Xi(t)^ 


Xi{t)^0 


Therefore, 


(30) 


(31) 


, . I oo ii k < 1 

lilXl —— \ g7[X)j = l if )^ = 1 


Xi(t)^0 Xi(t) 

As the same way, for any x* = 1 we have 


(32) 


0 


if > 1 


1-Xi(f+1) 

hm - 

1 _ Xi(t) 


OO if A; < 1 

0 if A; > 1 


(33) 


Therefore, substituting these relations (|32D-(^3D into eqn.(p6D, combining with the Jacobian 


matrix Jx eqn.(^) of internal point, we have the generalized Jacoban matrix of a hxed point 
X* = (x^, ...,x*) for internal, boundary or vertice points. 


Jx = diag{ki ,..., kn) H— diag{x\{l — x^),..., x* (1 — x*))lT 


(34) 


where 
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ki 


oo 








0 

k 


if /c < 1, x* = 0 or 1 

if /c = 1, x* = 0 or 1 

if /c > 1, x* = 0 or 1 

if x* ^ 0 or 1 


(35) 


Theorem 3.4 Assume W = W'^. 


1 . 


For synchronous updating, a fixed point X* in the region S is asymptotically stable if the 
largest eigenvalue X'^^x smallest eigenvalue of the matrix Jx satisfy X'^ax < 1 
and )(rain > “1/ Ike other hand, a fixed point X* in the region S is unstable if either 
X^rnax > 1 or < — 1 is Satisfied. Jx is defined in egn. 


m- 


2 . 


For asynchronous updating, a fixed point X* in the region S is asymptotically stable if 
1> max2=i[ki + ^x*{l — X*)] and min'f^fiki + ^x*{l — x*)] >—1. 


Proof of Theorem |3.4| . 

For synchronous updating: According to dynamical systems theory 0. the hxed point X* 
is asymptotically stable if absolute values of all eigenvalues for Jx at X* are less than 1. On the 
other hand, if there exists an eigenvalue with the absolute value more than 1, X* is unstable. 
Note that all eigenvalues of Jx are real numbers according to Theorem |(J.1| of Appendix 
For asynchronous updating. 

Without loss of generality, let neuron-/ be the updated neuron at iteration-(t-l-l), then 


dxi{t) xi{t){l - xi{t)) e 


(36) 


Analogously to the proof of synchronous updating, we obtain condition 2 for asynchronous 
updating, by using relations (^ ) -(|33| ) and eqn.(^BD. □ 

Let Ua, Da and La be an upper triangular, a diagonal and a lower triangular parts of Jx 
dehned in egn. (^41), i.e., Jx = Ua + Da + La. Dehne Xcmin, Xcmax to be the minimal and maximal 


eigenvalues of the matrix ( 1—La) ^{Ua+Da), respectively. Then, let us show a stricter theorem 
for cyclic updating. 

Theorem 3.5 Assume W = W'^. For cyclic updating, 

1. a fixed point X* in the region S is asymptotically stable if the largest eigenvalue Xcmax and 
smallest eigenvalue Xcmin of the matrix ( 1 — La)~^{Ua + Da) satisfy \Xcmax\ < 1 and 
|Acmin| ^ 1; 
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2. on the other hand, a fixed point X* in the region S is unstable if either \Xcmax\ > I or 

^ 1 satisfied^ 

3. when k <1, no point on vertices or boundary points is asymptotically stable. 

Proof of Theorem |3.5| . 

Since the cyclic updating is proceeded neuron by neuron, the total differential is, 


i—1 


dxi{t + 1) ='^mijdxjlf + 1)+ '^mijdxj{t) foTi = l,...,n (37) 

j=i j=i 

where, iriij is the {i,j) element of the matrix Jx defined in eqn.(^). 

Let us change the Jacobian matrix of cyclic updating into that of the effective synchronous 
updating. By dividing Jx into an upper triangular Ua, a diagonal Da and a lower triangular 
La [^, eqn. (|T7|) can be rewritten in terms of matrix form; 


dX{t + 1) = LadX{t + 1) + {Da + Ua)dX{t) 
Therefore, we have the effective synchronous updating Jacobian matrix. 


(38) 


jv = (1 - + f/j 


(39) 


Analogously to the proof of conditions 1 and 2 of Theorem IXl, the conditions 1, 2 and 3 of 
this theorem can be readily proven. □ 

Remark 3.3 Assume W = W'^, then in the internal points of X, only local minima of f{X) 
can possibly be asymptotically stable for eqn. w, regardless of synchronous or asynchronous 
updating. 


Proof of Remark 3.3 


The internal fixed points of f{X) are composed of local minima, saddle points and local 
maxima according to Lemma |3.1| . If a fixed point X* is a saddle point or a local maximum, 
which means that fxx{X*) is indefinite or negative definite (or semi-negative definite), then 
at least one eigenvalue for diag{xl{l — x\), ...,x*^{l — x*^)fxx{X*) is negative according to 
Theorem EH of Appendix y. Hence from eqn.(|28|), there is at least one eigenvalue of Jx whose 
absolute value is more than 1, which means that X* is unstable. Therefore, only local minimum 
of f{X) can possibly be asymptotically stable. □ 
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According to eqn. (|3^) , the closer x* {i = 1, ...,n) are to 0 and 1, the smaller the absolute 
values of eigenvalues X'^in X'^^^ are. Therefore, this implies that the system is likely to 
asymptotically converge to local minima near the vertices for — 1 < A; < 1. 


Remark 3.4 Assume W = W'^ 


1. When k < 1, no point on vertices or boundary points is asymptotically stable for both 
asynchronous and synchronous updating. 

2. When k > 1, all vertices are asymptotically stable for both synchronous and asynchronous 
updating. 


3. For both synchronous updating and cyclic updating, when k = 1, a vertex X* is asymp- 
totically stable if max^^^e ' ^ other hand, a vertex is 

unstable if max'^^.^e ^ 


> 1 . 


f. For random-order updating, when k = 1, a vertex is asymptotically stable if 


maxiLiC ' 


[ / j j _ 


< 1 . 


From conditions 1 and 2 of Theorem |3.4| , Theorem and x* = 0 or 1 for f = 1, the 
proof of this remark is trivial. 

Theorems p.4| - p.5| are useful for both designs of neural networks and applications of CNN and 
TCNN to practical problems, e.g., optimization or associative memeory, because they indicate 
which local minimum of the Lyapunov function is an attractor and which one is not. 


3.3 Local Bifurcations in TCNN 


Next, let us examine the bifurcations of the fixed points, in particular of the stationary points 
of f{X), by taking P as bifurcation parameters. P is a parametric column vector and may be 
dehned by P = (a;ii, ...,ujnn)'^ or other parameters in eqn.(||). 

Since many applications take minima of f{X) as targets of information processing, we focus 
on analysing bifurcations for the stationary points of f{X), especially for internal fixed points. 
Instead of eqn.(|^), we use eqn.(^ in the following analysis of the codimension one bifurcations 
of internal points, by applying the center manifold method p, p. 

Eqn.(D is rewritten as. 


y(i +1) = y(«) - P) ^Y(t)- P), (40) 









3 ASYMPTOTICAL STABILITY OF TCNN 


21 


f{X]P) is defined in eqn.(^ with parameters P expressed explicitly, and fx = 

Then the Jacobian matrix Jy{X{Y {t))] P) = of eqn. (|40D or eqn.(|^) at {X{t),P) 

becomes 


Jy = 1 - fxY{X{t);P) = l-^diag[xi{t){l-Xi{t)),...,Xn{t){l-Xn{t))]fxx{X{t);P) (41) 

where fxY = fxx = and fxx is a symmetrical matrix. Note that Jy of eqn.(^) is 
identical to Jx of eqn.(j2^) for an internal point of X. 

Lemma 3.2 Assume W = W'^, and take P as bifurcation parameters, then there is no Neimark- 
Sacker bifurcation for fixed points of eqn. ai- In other words, there only exist two types of 
generic codimention-one bifurcations, i.e., fold bifurcations (saddle-node bifurcations) and flip 
bifurcations (period-doubling bifurcations). Moreover all fixed point bifurcations occur at the 
stationary points of f{X). 

Proof of Lemma |3.2| . According to Theorem |(J.1| of Appendix y, all eigenvalues of Jy are 
real numbers, which implies that there is no Neimark-Sacker bifurcation. In other words, only 
fold and flip bifurcations generally occur as codimension one bifurcations when one eigenvalue 
of Jy is equal to 1 or — 1 Qgg. Eqn. 0 ) shows that all hxed point bifurcations occur at the 
stationary points of f{X). □ 

Let Y* or X* [x* = -—for i = 1, ...,n) be an internal hxed point, which is in fact a 
stationary point of /(X; P) for W'^ = W according to Lemma |3T| . Let P^ be the critical values 
for bifurcations. Then can be expanded in the vicinity of {Y*, P^) in Taylor series with 

respect to both variables Y and parameters P, such that eqn.(|40|) becomes, 

Y{t + 1) = Y{t) - [/xyAP + IfxYYiAY ■ AY) + i/xyyy(AF ■ AF ■ AF) + ...] 

— [fxpAP + /xpy(AP ■ AF) + ...] — ..., (42) 

where, AF = Y (t) — Y*, AP = P — P^ and /xyy(A*; P^) is a block matrix. 

Since X* or Y* is a hxed point and are the critical values of bifurcations, fx{X*] Pfl = 0 
and at least one of eigenvalues for the Jacobian Jy{X*] P^) at (X*, P'^) is A = 1 or A = —1. 

Let us hrst analyse the case of A = 1 by using the center manifold method. Let U, Pf 
be the normalized right and left eigenvectors of Jy, respectively. That is, Jy{X*-, P^)U = P; 
U^Jy{X*; P") = Pt and PtP = 1, or 









3 ASYMPTOTICAL STABILITY OF TCNN 


22 


fxY{X*;P^)U = Eo. (43) 

Note that [/'•' is a row vector. Since fxY{X*]P^) = ^diag{x\{l — x* (1 — x^))fxx 

and x*{l — X*) > 0 for i = eqn.(|43|) implies that fxx{X*-,P^) has at least one zero 

eigenvalne. 

Then the center snbspace at the vicinity of the bifnrcation point can be dehned by 


Y{t) =Y* + a{t)U, (44) 

where a{t) is a scalar and a snfficiently small real nnmber. 

Snbstitnting eqn. (|4^) into eqn. (^2]) and then mnltiplying W to eqn.(|4^), we have 


a{t + 1) = a{t) - [^U^f^yy{U ■ U) + ^U^f^yyy{U ■ U ■ U) + ...] 

-[U^fxpXP + a{t)U^fxPY{XP ■ U) + ...] - (45) 

which is a one-dimensional difference eqnation for variable a{t) with parameters AP. 
Therefore, according to bifnrcation theory P, |^, the following theorem holds. 

Theorem 3.6 Let W'^ = W. Assume that X* is an internal fixed point of eqn. m) or eqn. & 
and that fxY{X*;P^) has one zero eigenvalue with the right eigenvector U and the left eigen¬ 
vector W. Then for synchronous updating, a fold bifurcation (saddle-node bifurcation) occurs 

^f 


U^fxYYiX*;P'^)iU-U)^0 

and 

U^fxp{X*-P^)^D. 

Since the bifnrcations in Theorem occnr when fxx{X*]P^) has zero eigenvalne and 
fx{X*]P^) = 0, they are actnally stationary point bifnrcations of f{X]P). 

Remark 3.5 The fold bifurcations for fixed points in Theorem \3. 6| generate or eliminate a pair 
of stationary points of f{X]P) with the perturbations of parameters. 

Next, let ns analyse the case that the Jacobian matrix Jy has at least one eigenvalue A = —1. 
Let X* be a fixed point and V, be the normalized right and left eigenvectors satisfying 
Jy{X*; P^)V = -V; V^Jy(X*; P") = -V^ and V^V = 1, or 
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fxY{X*-P^)V = 2V. (46) 

In other words, diag{x\{l — x\), — x*^))fxx{,X*] P'^) has at least one eigenvalue 2e (> 

0). By using Theorem |C.1| of Appendix |y, it is easy to show that fxx{X*; P^) has at least one 
positive eigenvalue at the critical point. 

Then the center subspace at the vicinity of the bifurcation point can be dehned by 


Y{t) = Y* + h{t)V, 

where h{t) is a scalar and a sufficiently small real number. 
As the same way of derivation of eqn.(53), we have 


(47) 


b(t + 1) = -b{t) - |A£\/t/„.,.y(V'. V) + ^VbfxYYriV ■ 1/ ■ V) + ...] 

2 6 

-[V^fxpAP + b{t)V^fxPY{AP ■ V) + ...] - ..., (48) 


which is a one-dimensional difference equation for variable b{t) with parameters AP. Note 
that is a row vector. 

Therefore, according to bifurcation theory |^, ^], the following theorem holds. 


Theorem 3.7 Let W'^ = W. Assume that X* is an internal fixed point of eqn. m or eqn. & 
and that diag{x*i{l — x\), ...,x*^{l — xlf))fxx{,X*]P^) has one eigenvalue 2e with the right eigen¬ 
vector V and the left eigenvector 1/1. 

Then for synchronous updating, a flip bifurcation (a period-doubling bifurcation) occurs if 

P'))!/ . V')|= - Ahyyy{X\ nX ’ V ■ V) ^ 

and 


2V^fxPYiX*;P^)V-[V^fxpiX*;P'^)][V^fxYYiX*;P^){V-V)]^0. 

Since the flip bifurcations in Theorem |3.7| occur when fxx{X*', P^) has a positive eigenvalue 
and fx{X*] P'^) = 0, these bifurcations only stabilize or unstabilize the local manifold along the 
direction of the eigenvector corresponding to the positive eigenvalue of fxx{X*-, P^). Therefore, 
the flip bifurcations do not generally create or eliminate any stationary point of f{X*] P), but 
may unstabilize or stabilize local minima of /(X; P). 









3 ASYMPTOTICAL STABILITY OF TCNN 


24 


Remark 3.6 The flip bifurcations for fixed points in Theorem \3.'T[ occur at either a saddle 
point or a local minimum of f{X-,P). The flip bifurcations for fixed points cannot create (or 
eliminate) stationary points of f{X*] P) with the perturbations of parameters although it may 
cause a change of stability of a fixed point together with the birth of a new period two orbit. 


Since one eigenvalue of fxx is positive for the flip bifurcation, the flip bifurcation only occurs 
at a local minimum or a saddle point of /(X; P). As the fold and flip bifurcations are generic, 
most bifurcations can be expected to be fold bifurcations and flip bifurcations when ||P|| is 
reduced from a sufficiently large value to zero if we define P = (a;ii, as temperature 

parameters to realize annealing of eqn.(^) or eqn.(^) P]. However, if a dynamical system has 

certain symmetries, the other bifurcations can also be observed, such as pitchfork bifurcations 
and others p5| . 

In this subsection, we only examine the bifurcations of synchronous updating for the sake 
of the simplification of analysis. However, the bifurcation conditions of asynchronous updating 
can be derived analogously to synchronous updating. 

Obviously, all of analyses in this section are independent of the values of / and Iq in eqn.(|D. 
If Jo = Eq, eqn.(^ or eqn.(|) is equivalent to chaotic neural networks (CNN)[|]. Therefore, we 
have the following remark. 


Remark 3.7 All of the theoretical results in this section hold for chaotic neural networks 
(CNN) i/. 
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4 Chaos in Transiently Chaotic Neural Networks 


In the first of this section, one theorem for existence of a hxed point with sufficiently large 
absolute values of self feedback connection weights is derived. Then, we give sufficient conditions 
for chaos by applying Marotto’s Theorem in the last of this section. 

Analysis in this section is mainly based on synchronous updating, but it is easy to apply it 
to asynchronous updating. In other words, all the theoretical results in this section hold for 
both synchronous and asynchronous updating. 

Furthermore, for the sake of the simplihcation of analysis, assume that all the self-feedback 
connection weights take the same value in this section, i.e., Ua = u {i = 1, Therefore, 

diag{ujii, ...,ujnn) in eqn.(^ simply becomes to 1 (or diagiuin, ...,a;„„)/o = ojIq in eqn.(|)). 

4.1 Fixed point in TCNN 

Firstly, we show that eqn.(H) possesses a hxed point for sufficiently large |a;|. 


Theorem 4.1 Assume 1 > Ooi > 0 for i = l,...,n, then there exists a positive constant Ci 
such that for any |a;| > Ci the discrete-time system of eqn. has one fixed point Y* which is 
bounded. If |a;| is sufficient large, Y* is a unique bounded fixed point. 


Before proving Theorem [4.1|, we present the following lemma. 


Lemma 4.1 Assume the same conditions as Theorem U-1 


such that the following three conditions hold for all |a;| > C 2 . 


There exists a positive constant C 2 


1. W is invertible and Eq < — ujIq) < Ei. 

2. Y{uj) = {Y\X(Y) = — ujIo)} is the unique fixed point of eqn.^ when k = 1. 

3. Y (a;) is bounded and further Y^a = lim|^^|^oo ^(i^) = ,..., Y■ 


Proof of Lemma fl.l|. Since for any u ^ 0 


1 

0021 

OJ12/0J ■ 

1 

•• ^In/^ 

■■ LV2nl^ 


(49) 

LVnll^ 

^n2l^ ■ 

1 _ 




then lim|^|^oo kko = 1, where 1 is the identity matrix. Therefore, W is invertible for any 
sufficiently large |a;|, i.e., IV~^ = Moreover, 
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lim -W-\I - (jIo) = lo 

|aj|^oo 


(50) 


Hence, by the assumption of this Lemma, there exist a C 2 (> 0) such that Eq < — 

ujIq) < El for all |a;| > C 2 . 

Since X{Y) is a monotonously increasing function for Y, and the value region of X{Y) is 
Eq < X{Y) < El for a bounded Y according to eqn.(||), Y(oo) = {Y\X{Y) = — a;/o)} 

is the unique fixed point of eqn.(|^) when A; = 1 for all |a;| > C 2 , and is obviously bounded. 

Finally, from eqns.(|^) and @), Y^o = lim|^|^oo ]^, which is also 

bounded. □ 

By using Lemma O, we prove Theorem EH 

Proof of Theorem |4.1| . Let U = i?°(T(a;), ei), where ei is a bounded arbitrary positive 
number. Now, we prove that there exists a ci(ei) (> 0) such that eqn.(|) has one hxed point 
Y* E U for any |a;| > Ci(ei). For any |a;| > C 2 (c 2 is given by Lemma [4.1|), let 


Q(Y;u;) = -[{k-l)Y+ WX{Y) + I-ujIq]. 

UJ 


From the condition 2 of Lemma 4.1, 


(51) 


(3(F; ui) = ![(*:- l)y + WX(Y) + / - ljIo] = L—IT, 

(J 00 


Then, according to the condition 3 of Lemma 4.1, 


(52) 


lim ||(3(F;ij)|| = 0, 

|a;|—>00 


(53) 


which means Y = Yioo) is an approximate solution of QiY^oo) = 0 for a sufficiently large 
number |a;|. 

Next, from eqn.(^), the Jacobian matrix is 


Qy{Y-,uo) = -[{k - 1) 1 + -WZ{Y)] = ^^ 1 + -WqZ{Y) 
00 e 00 e 




, where 


z(y) = 


a:i(!/i)[l 

0 


0 


Since for any bounded Y E U including Y, 


(54) 


( 55 ) 
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1 1 ” 

lim det{QY{Y;uj)) = lim det{-WoZ{Y)) = lim - ]^ a;i(|/i)[l - Xi{yi)] ^ 0, 

li^l^oo >oo 6 |cj|—>c» 6 

then, there exists a C3(ei) (> 0) such that ||Qy(F;a;)“^|| < di and HQy(h';a;) — Qy(F;a;)|| < 
fii/di for a sufficiently large positive number di and for a positive number fii (< 1) with any 
|a;| > C3(ei) and any Y E U. 

Therefore, there exists a ri (> 0) such that ri < (1 — yi)ei/di and, according to eqn. (|^ , 
there exists C4 (> 0) such that ||Q(F;a;)|| < ri for all |a;| > C4. Let Ci(ei) = max(c2, 03(61), C4), 
then the following three conditions hold for all |a;| > Ci(ei). 


1. f](6i) = {y|||y-F||<ei}ci7 

2. ||gy(F;a;)-Qy(F;a;)|| </ii/di 

3. < 61 , where ||g(F;a;)|| < ri and HQy(F;a;)“^|| < di. 

According to Urabe’s Proposition (Urabe, 1965; see the Appendix ^)|^, Q{Y;uj) = 0 has 
a unique solution Y*{uj) in F(ei) C U for all |a;| > Ci(ei). That is. 


-[{k - l)y* + WX{Y*) + I-u;Io]=0 (56) 


Y* = kY* + WX(Y*) + I -ujIo = fiY*) (57) 

which means that eqn.(|^) has one unique hxed point Y E U for all |a;| > Ci(ei). Since U is 
a bounded set, Y* is bounded. 

Next, let us show that Y* is a unique hxed point for all bounded region if |a;| is sufficient 
large. Assume Y^ to be another bounded hxed point diherent from Y*, in other words Y^ ^ U. 
Since both Y* and are hxed points of eqn.(|^) and W is invertible, the following relation 
holds. 

X{Y*) - X{Y^) = -{k - 1)W-\Y* - y°) = -^^Wo\Y* - r°) 

UJ 

Therefore, X{Y*) — X{Y^) or Y* — Y^ approaches zero when |a;| is sufficient large, because 
Y* and Y^ are bounded. Since Y* E U, there exists a sufficient large cq (> 0) such that 
Y^ EU for all |a;| > Co, which contradicts the uniqueness of the hxed point in U. Therefore, 
the theorem is proved. □ 
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Remark 4.1 Assume the same conditions as Theorem Define = limi^^i^oo ^*7 then 
= Yoc = e[lnj^^,Y, which is also a unique fixed point (bounded) for |a;| —> cx). 


Proof of Remark |4.1| . Since Y^ is bounded, and 


1 (k — liy* 4 -1 

llm -|(fc - l)y^ + +I-Uk]= lim + w,x{yz) - /„] 

|aj|^oo UJ |a;|^oo (jJ 

= ^(14.) - /o = 0. (58) 

Hence, the Remark is proven. □ 

According to eqn.(^^, fxx is positive definite if a; is sufficiently small (negative). On the 
other side, fxx is negative definite if to is sufficiently large (positive). 

Remark 4.2 Y* or X{Y*) is a unique minimum of f defined in eqn. if 10 is sufficiently 
small (negative). On the other side, Y* is a unique maximum of f if uj is sufficiently large 
(positive). 


Remark 4.3 Assume the same conditions as Theorem \4.1\ . If aoi = 0 (i = 1, ...,n), there is no 
bounded fixed point for sufficiently large |a;|. 


The proof of this remark is straightforward from Remark |0. 


4.2 Existence of chaos in TCNN 


Next, we establish a principal result of this section. 


Theorem 4.2 Assume 1 > aoi > 0 for i = 1, ...,n, and 


1. k > for i = I, ...,n, uj < 0; 

l-an,; ) ) 7 7 


or 


2. k < —1, UJ > 0 ; 
or 

3. k > for i = 1, ...,n, UJ < D, 

aoi J 5 7 7 7 

then there exists a positive constant C 5 such that for any |a;| > C 5 the discrete-time system 
of eqn. ^ is chaotic in the sense of Marotto. 


Theorem |4.2| can be proved by the following two preliminary lemmas. 
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Lemma 4.2 There exists a positive constant Cq such that all eigenvalues of FyiY) exceed the 
unity in norm for all |a;| > cq and for any bounded Y. 


Proof of Lemma 4.2 


From eqn.(|), 


Fy{Y) = kl + -WZ{Y) = 


k + ojxiil — xi)/e 


^n) /^ 


(59) 


UlnlXl{l - Xi) / e k + UlXn{l - Xn) / e 

Let ij) = 1, ...,n) be eigenvalues of FyiY) for any bounded Y, and 9i = k + — 

Xi)/e]ri = \x>ij\xj{l — Xj)/e; {i = 1, Then according to Gerschgorin Theorem (see 

Appendix P), Xp G UILi g); (p = 1,.In other words, there exists a set Sq C 
such that the following inequalities hold for some i E Sq. 


Ti > \9i - Apl > \9i\ - |Ap| > |a;a;i(l - Xi)/e\ -k - |Ap|; (p = 1, ...,n) (60) 

Hence, |Ap| > |a;|a;j(l — Xi)/e — k — \^ij\xj{X ~ Xj)/e for p = 1,and i G Sq. 

Since Y is bounded, x* 7^ 0 or 1. Define Cg = max'f^^[{l+k)e+YJj^^ \oJij\xj{l—Xj)]/[xi{l—Xi)], 
then for any |a;| > Cg, |Ap| > 1 (p = 1, which proves the Lemma. □ 


Lemma 4.3 Assume the same conditions as Theorem then Y* is a snap-back repeller for 
any |a;| > cg. 


To prove Lemma we have to show that, (a) there exists a fixed point Y*; (b) there is a 
bounded r such that the absolute value of all eigenvalues of Fy for B{Y*]r) is larger than 1; 
(c) there is a point G B{Y*;r) and Y^* 7^ Y* such that = y* holds, when |ci;| is 


sufficiently large. Actually, Theorem ^ and Lemma ^ ensure (a) and (b). Next, we find a 
Y°* to prove F^{Y^*) = Y*. 

Proof of Lemma ^4.3| . We first prove the conditions 1 and 2 of Theorem [4.2|, and then 
show the condition 3. 

For any |a;| > Ci, define {Hi ,..., iL„) as 


[Hi,...HnY = 


-1 


(61) 


Proof of conditions of 1 and 2 : 
Let G = {gi, ...,gnf, where. 
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Then define 



Y*-I + ulo 
k 


— I + a; Jo — ek 


aoi(l+l/A:) 
1—aoi (1+1/fc) 


aonjl+l/k) 

’'"'l-aor.il+l/k) _ 


(62) 


Y« 




9n I'T 
- 9n 


(63) 


Therefore, X{Y^) = G by eqns.(|5|), (|6^) and (|6^) . Note that the following condition should 
be satisfied in eqn.(|63D. 


0 < gi<l (i = 1, ..,n) (64) 

Since limi^l^oo = (l + l/fc)aoi = 1,n) because of limi^^l^oo = 1, hence, according 


to the conditions 1 and 2, there exists a cy (> 0) such that eqn. fplD holds for all |a;| > cy. 
Since gi {i = 1, ...,n) is bounded, is also bounded. Actually, from eqn. (|6^) 


lim K» = £|!n^(Al±iZf) +1/*;) ,t 

|aj|—^oo 1 — -|- 1/fc) 


(65) 


1 ~ fl0n(l + 1/^)’ 

which is not equal to according to Remark b:.l| . Therefore, there exists a positive numbers 
Cg and €2 such that Y* ^ B(Y^; € 2 ) for any |a;| > Cg. 

Furthermore, from eqns.(0) and 


F(y°) = -{Y* - I + ujIo) + ke 
k 


In 


91 


In 


aoi(l+l/fc) 


l-gi l-aoi(l+l/A:) 


In-r^ - In- 


aOn(l+l/fc) 


'l-Qn l-aOn(l + l/fc) . 

Next, we use Urabe’s proposition again to prove the lemma. 

Let 


QiY;u;) = -[F{F{Y)) - F*] = -[F^Y) - F*] 

(jj (jj 


then 


k^f 

Q(F°;a;) = — 

OJ 


In^ - In 


apijl+l/k) 


l-gi l-aoi(l+l/A:) 


In-^ - In 


dQn 


l-g-n l-aOn(l + l/fc) . 


+ -fFX(F(F°)) 

OJ 


From eqns. (|6^) and (|66D , for sufficiently large |a;| 

ojIq 


F(F^) oc 


k 


( 66 ) 


(67) 


( 68 ) 


( 69 ) 


which is negative because of the conditions of 1 and 2. Hence, 
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lim WX{F{Y°)) = Eo (70) 

|aj|—>oo 

Therefore, 


hm ||Q(F°;a;)i|=0 

|lj|—^■ oo 


(71) 


which means Y = Y^{uj) is an approximate solution of Q{Y-,uj) = 0 for a sufficiently large 
number |a;|. 


Dehne 0 as a n x u zero matrix where all elements are zero. By eqn. (|67|) , 


Qy{Y; cu) = [k l/co + WoZiY)/e] [k 1 + ujWQZ{F{Y))/e.] (72) 

Since 

n 

lim det{WoZ{Y^)) = TT(1 + l/k)aoi[l - (1 + l/k)aoi] ^ 0 (73) 

hm k 1/u! = 0 (74) 

|a;|—^■oo 

and 

hm -WoZ{F{Y^)) = 0 (75) 

|a;|—^■oo 6 

because of the conditions of 1 and 2 and eqn.(|69|), 

hm|^l^ooC^ef(Qy(F°;a;)) = f nr=i(l + l/k)aoi[l - (1 + l/k)aoi] 7^ 0 

which implies that there exists a Cg (> 0 ) such that for a sufficiently large positive number d2, 
||(5y(F°;a;)“^|| < ^2 for any |a;| > Cg. Furthermore, for a positive number /i 2 (< 1), there exists 
a positive number 63 (< 62) such that \\Qy{Y;uj) — ( 5 y(F°;a;)|| < ^2/d2 for all Y G B{Y^] 63) 
Therefore, there exists a r2 (> 0) such that r2 < (1 — 412)^2/d2 and, according to eqn. O, 
there exists Cio(e2) (> 0) such that ||( 5 (y°;a;)|| < r2 for all |a;| > Cio(e2). Let 011(62) = 
max{ci, C 7 , cs, cg, 010(62)), then the following three conditions hold for all |a;| > 011(62). 

1. f2(63) = {F| r - < ^3} c B{Y^- 62) 

2 . \\Qy{Y-u) - Qy{Y^-,uj)\\ < fi2/d2 


3- < ^3, where ||(5(f^°;a;)|| < r 2 and \\Qy{Y^]uj) ^|| < d 2 - 
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According to Urabe’s Proposition (see the Appendix ^ Q{Y;uj) = 0 has the unique 
solution Y^*{uj) in r2(e3) C B{Y^; € 2 ) for all |a;| > 011 ( 62 ), which also implies Y^* 7^ Y* according 
to the dehnition of B{Y^; 62 ). That is, 


Y* = F{F{Y^*)) = F^{Y^*) (76) 

for all |a;| > 011 ( 62 ). By Lemma there exists a O 12 (> 0) and 64 (> 0) such that all 
eigenvalues of Fy{Y) exceed the unity in norm for all |ci;| > 012 and for any Y G B{Y*]e 4 ), 
where Y^* G - 8 ( 1 ^*; 64). Let 05 = max(on, O12), then Y* is a snap-back repeller. 

Proof of condition 3: 

Let G = (gi, where. 


9i = 


Hf .Y* - I - u(E 4 - lo) 


00 


k 


I Y x’Lq — ck 


aoi(l+l/fc)-l/A: 

"''l-aoi(l+l/fc)+l/fc 


7 aon(l+l/fc)-l/A: 

"fo-ao„(l+l/fc)+l/fc J 


Define 




1 - S'! 1 - S'; 

Note that the following condition should be satisfied. 


(77) 


(78) 


0 < 9i < 1; (»= 1. ■■>")■ 


Furthermore, 


F(F°) = -[Y*-I- u:{E, - fo)] + ke 


In 


In 


aoi(l+l/fc)-l/fc 


.91 

I-91 l-aoi(l+l/fc)+l/fc 


1 r) . 9 ^ _ 1 rf-i * 707^(1 + 1 /^) 1 /^ 

fo-9~ "fo-ao„(l+l/fc)+l/fc 


Hence, for sufficiently large |a;|. 


F(y“) oc 


uj{Ei — 1q 

k 


(79) 


(80) 


(81) 


which is positive because of the condition 3. Note that the condition 2 also satishes eqns. o 
and (p^. 

Then as the same way as the proof of conditions 1 and 2, condition 3 can be proved. □ 


Proof of Theorem 4.2 . By Lemma |4.3| and Marotto’s Theorem, the proof is straightfor¬ 


ward. □ 
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Obviously, there are two different type of snap-back repellers for Lemma One is 

{yo* (sufficiently negative) F{Y^*) Y*} corresponding to conditions 1 and 2, the 

other is (sufficiently positive) F{Y^*) y*} corresponding to conditions 3 and 2. 


Remark 4.4 Chaos in eqn. is generated not from a saddle point, but from a repeller when 
|a;| is sufficiently large. 


Theorem 4.3 Y{t) of eqn. is bounded for any initial value y(0) if —1 < k < 1. 


Proof of Theorem [4.3| . Let di 

to eqn.(0) 


\^ij \ + which is bounded. According 


kyiit) - di< yi{t -M) < %(t) dp, {t = 0,1,...) (82) 

For the case of k > 0 : From the right hand side of eqn.(|8^) for t,t — 1, ...0, 

yi(t + 1) < k'^Uii't - 1) + kdi + di< ... < fc*+^|/j(0) di (83) 

On the other side, from the left hand side of eqn.(l8^) for t,t — 1, ...0, 

Viit + 1) > k'^Viit - 1) - kdi -di> ... > fc*+^|/i(0)--- —di (84) 

1 — k 

Since |/i(0), di are bounded and < 1 for f = 0,1,..., yt+iit + 1) is bounded. 

For the case of k < 0 : As the same way, we can show 

1 _ ( _ 1 _ ( _ 

-—-r- di < yi{t + 1) < k^^^yi{0) H-—— - di, (85) 

1 + k 1 + k 

thereby proving that any yi(t + 1) is bounded for any initial value |/i(0). □ 

As a matter of fact, for steady states, i.e., when t is sufficiently large, or {—ky~^^ —>■ 0. 

That means that, |j/i(t-|-l)| < according to eqns.(P3D-(P5[) for any j/i(0) when t is sufficiently 

large. 

Example 4.1 Consider a one-dimensional case of eqn. 

9 (i + 1) = ky{t) + uix(p(t)) + a-u>aa ; x(y(t)) = ^ ■ 

Let k = 0.9; e = 1/250; a = 0;ao = 0.65. Figure shows the output of the neuron and the 
Lyapunov exponent & with increasing |a;|. 
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We first use the condition 2 of Theorem 3.1 or Theorem |3.2| to estimate the stability of this 


example. According to the condition 2 of Theorem |3.2| , the estimated value of a; is cUe = —8ke = 
—0.0288, below which the system can be ensured to be stable. If —a; < 0.0288, the system is 
stable and converges to a hxed point, which is verihed by the numerical simulation in Figure [^. 

Next, we use Theorem ^.4| to calculate the hrst bifurcation point and to analyse the dynamics 
exactly. The hxed point satishes 


{k — l)eln-. 


x{t) 


+ ujx(t) — uao = 0. 


1 — x{t) 

According Theorem |3.4|, the condition under which the hxed point is stable follows 


( 86 ) 


k H— ujx{t){l — x{t)) > —1, 


(87) 


because we only analyse the dynamical behaviour for k > 0 and a; < 0. Therefore, by solving 
eqns.(P^ and ([57|), we obtain the critical values of u and the hxed point x*, 


u;^ = -0.033104; = 0.64289. 

Therefore, If —u < 0.033104, the system is stable and converges to a hxed point; at —u = 


0.033104, the hxed point bifurcates into 2-periodic points which is conhrmed by Theorem 3. 


when —00 > 0.033104, the system becomes unstable. These facts are verihed by the numerical 
simulation in Figure |^. 


Finally, we use the condition 3 of Theorem 4.2 to analyze chaotic dynamics of this exam¬ 


ple. According to the condition 1 of Theorem [4.2|, there exists chaotic behavior when —oo is 
sufficiently large. Actually, in this example, when —oo > 0.0596, the chaotic behavior appears, 
which is numerically verihed by positive Lyapunov exponent in Figure ^ although there also 
exist many periodic windows. 
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5 Asymptotical Stability in Discrete-time Recurrent Neural Net¬ 
works 


In this section, we firstly give a general form of discrete-time recurrent neural networks. Then, 
several convergence theorems for symmetrical versions of DRNN are addressed. All the theo¬ 
rems in this section can be proved by similar arguments as in section 3. 

5.1 Difference scheme 


The continuous-time recurrent neural network can generally be written in forms of differential 
equations as follows (Amari, 1972; Hopfield,1984): 


Xi = 


1 -h 


di/i ^ T N 

—— Cli (?' 1 , 

at 


( 88 ) 


where all variables and parameters are real numbers. 

Then, the discrete-time recurrent neural networks (DRNN) on the basis of the Euler method 
are given in eqns.(^). 


R(f +1) = F(F(f)) =kY{t) +^t[WX{Y{t)) +I] (89) 

where Af > 0, fc = 1 — /lAf and. 


Y{t) = 

1 

rH 

1 _ 

, X{Y{t)) = 

1 

_1 

_ 

r 1 1 


. Vnit) _ 


1 

1 _ 


1 



ai 


Uii 

Ui2 ■ 

^In 

I = 

, w = 

<^21 

1X22 ■ 

■ • (^2n 




. <^nl 

X>n2 ■ 

^nn 


Eqn. (^9|) is a neural network model with discrete-time and continuous-state |]^. Obviously, 
F in eqn. (|89[) is a class function for any bounded Y. 

To analyse asymptotical stability of X(f), we rewrite eqn. (|89|) by explicitly expressing A(t), 


X{t + 1) = F(A'(i)) = 



L 1+e 




(90) 


where, 0 < Xiit) < 1 for i = 1,..., n and k = 1 — /lAf. 
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Remark 5.1 The fixed points in eqn. (j5^ are identical to the fixed points of eqn. or eqn. ((£^. 
Moreover, the fixed point is independent of At. 


Proof of Remark |5.1| . 

Since the equations by setting ^ = 0 in eqn. (|88D are equivalent to the equations by yfit+l) = 
yfit) in eqn.(|5D|), they must have the same hxed points. □ 


Remark 5.2 IfW = W’^ and p > 0, eqn. m) or eqn. coincides with a difference equational 
version of the Hopfield neural networks / |7^ a w- 


5.2 Asymptotical stability of DRNN 

Similar to TCNN, we give several convergent theorems for eqn. (0). to show that the system of 
eqn. can asymptotically converge to a stable hxed point if certain conditions are satished. 
Let Xmin be the smallest eigenvalue of matrix W. 


Theorem 5.1 Assume W = , and 

1. 1/3 > fc > 0, 4(1 - k)e > -AtXmin (or 4/ie > -Xmin) 
or 

2. 1 > A; > 1/3, S/ce > —AtXmin 
or 

3. fc > 1, 8e > —AtXmin- 

Then the discrete-time system of eqn. asymptotically converges to a fixed point, as far as 
eqn. w is synchronously updated, where k = 1 — pAt. 


Remark 5.3 Assume W = . According to Gerschgorin Theorem (see Appendix^, 

1. if 0 < k < 1/3; AtuJii + 4(1 — k)e > At\jyfjLiOJij\ for i = l,...,n, then the matrix 
AtW + 4(1 — k)e 1 is positive definite; 


2. if 1/3 < k < 1; AtoJii + 8fce > At\ for i = I, ..., n, then the matrix AtW + 8A:e 1 

is positive definite; 
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3. if I < k; AtuJii + 8e > At| for i = 1, n, then the matrix AtW + 8e 1 is positive 

definite. 

These show that the system of X{t) is asymptotically stable. 


Theorem 5.2 Assume W = W'^, 

1. l/3>/c>0, 4(1 — k)e > —At min'f^iOJu 
or 

2. 1 > /c > 1/3, 8 fce > —At min^^ywa 
or 

3. k > 1, 8e > —At min’^^^Uii. 

Then the discrete-time system of eqn. m asymptotically converges to a fixed point, as far as 
eqn. m is asynchronously updated, where k = 1 — fvAt. 


1 ^ ^ ^ ^ ^ rXi ^ 

f{X) = --J2 AtOiXi - {k-l)eJ2 J ln-^-—dx 

ij i i ^ ^ 


(91) 


Define 


Then, Theorems and |5.2| can be proved as the same procednres of Theorems |3.1| and 
by showing that f{X) is a Lyapnnov fnnction of eqn.(pO|) for both synchrononsly and 
asynchrononsly np dating. 


Remark 5.4 Theorem \5.1\ and Theorem \5.2i ensure that asymptotically stable points of discrete¬ 
time recurrent neural networks, i.e., eqn. or eqn. ^l\) are identical to those of continuous¬ 


time recurrent neural networks, i.e., eqn. with W = . 


Remark 5.5 If k = 0 and W = , the attractors of eqn. (M) for both synchronously and 

asynchronously updating, include only fixed points and 2-periodic points ES regardless of any 
values of ujij and At. 


This fact can be readily shown by nse of the resnlts of Marcns and Westervelt 


19 


Lemma 5.1 Assume W = . 


1. Fixed points of X{f) for egn. are composed of stationary points of f{X) (i.e., all of 


local minima, local maxima, saddle points of f{X(t))) and all of the vertices of X{t) 
regardless of synchronous or asynchronous updating. 
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2. As far as k ^ 1 or ^ D, there is no stationary points of f{X) on the vertices or boundary 
points of X. 


Theorem 5.3 Assume the same conditions as Theorem \5.1\ or Theorem \5 .4 Then a point 
is asymptotically stable for eqn. if and only if this point is a local minimum of f{X) for 
Eo< X < El. 


Corollary 5.1 Assume the same conditions as Theorem \5. j| or Theorem ^. 2^ and assume ovu = 0 
for i = 1, ...,n and p = 0, then a point X(t) is asymptotically stable for eqn. if and only if 
this point is a local minimum of f{X) for Eq < X < Ei on the vertices. 


Although Theorem |5.1| and Theorem p.2| are simple and easy to apply, they are conservative 
estimators for the evaluation of asymptotical stability. Next, we give two more general theorems 
to evaluate the local stability in an exact manner in a similar way as Section 3. 

For synchronous updating, define the Jacobian matrix Jx of eqn. (TO) at X(t) as; 




dX{t) 

Xi{t + 1)[1 - Xi{t + 1)] 


a;i(t+l)[l-a:i(t+l)] 


0 


0 


Xn (i+l) [1 — Xn (t+l)] 

Xn(t)[l-Xn{t)] 


0 


0 


Xn{t + 1)[1 - Xn{t + 1 )] 


AtW. 


Then for any Xj = 0 or 1, 


(92) 


(93) 


Xi{t + 1) 

hm -^ 

Xi{t) 


oo ii k <1 

= g7Ei=i = i 

0 if fc > 1 


(94) 


, . I cx) if fc < 1 

lim -= <1 g-7Ej=i ^ ^ 

1 — Xi[t) 


0 if A: > 1 

Therefore, the Jacobian matrix for a fixed point X* = [xl, ...,x*) is 


(95) 


Jx = diagiki ,..., k^) + ^diag[xi{l - Xi),..., x„(l - Xn)]W 


(96) 


where 
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k, = I e 


oo 


if A; < 1, x* = 0 or 1 

if ^ ^ = 0 or 1 

0 if /c > 1, a:* = 0 or 1 

k if x* 7 ^ 0 or 7 ^ 1 


(97) 


Next, we give a theorem generalized to boundary points and vertices and internal points of 


X. 


Theorem 5.4 Assume W = . 


1. For synchronous updating, a fixed point X* in the region S is asymptotically stable if the 

largest eigenvalue X'max smallest eigenvalue X'^in ^ke matrix Jx satisfy X^rnax < 1 
and X^rnin > on the other hand, a point in the region S is unstable if either X^^ax > 1 

or X^rnin < “1 *'5 satisfied; where, Jx is defined in egn. m- 

2. For asynchronous updating, a fixed point in the region S is asymptotically stable if 1 > 

max^^fiki + — x*)] and minf^fiki + ^^x*{l — x*)] > —1. 

Proof of Theorem |5.4| . 

For synchronous updating. 

The Jacobian matrix is given in eqn.(^), and all eigenvalues of Jx are real numbers according 
to Theorem |C.1| of Appendix p. 

For asynchronous updating: Without loss of generality, let neuron-/ be the updated neuron 
at iteration-(t-l-l), then 


dx,(t + 1) ^ ^ x,(t +1)11+1)1 ^ ^ 1,1 


(98) 


dxi{t) xi{t){l - xi{t)) e 

Analogously to the proof of Theorem 3.4|, we obtain conditions 1 and 2. □ 

Let Ua, Da and La be an upper triangular, a diagonal and a lower triangular parts of Jx 
dehned in eqn.(p^, i.e., Jx = Ua + Da + La- Define Xcmin, Xcmax to be the minimal and maximal 
eigenvalues of matrix ( 1 — La)~^{Ua + Da), respectively. Then, let us show a stricter theorem 
for cyclic updating. 

Theorem 5.5 Assume W = . For cyclic updating, 

1. a fixed point X* in the region S is asymptotically stable if the largest eigenvalue Xcmax ond 
smallest eigenvalue Xcmin of the matrix ( 1 — La)~^{Ua + Da) satisfy \Xcmax\ < 1 and 
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2. on the other hand, a fixed point X* in the region S is unstable if either \Xcmax\ > I or 
^ 1 satisfied. 


Remark 5.6 Assume W = W'^, then in the internal points of X, only local minima of f{X) 


can possibly be asymptotically stable for eqn. regardless of synchronous or asynchronous 
updating. 


According to eqn.(p6|), the closer x* {i = 1, ...,n) are to 0 and 1, the smaller the absolute 
values of eigenvalues and are. Therefore, this Theorem implies that the system is 
likely to asymptotically converges to local minima near the vertices for — 1 < 1 — /lAf < 1. 

Remark 5.7 Assume W = . 


1. When k <1, no point on vertices or boundary points is asymptotically stable. 

2. When k > 1, all vertices are asymptotically stable for synchronous and asynchronous 
updating. 


3. For both synchronous updating and cyclic updating, when k = 1, a vertex X* is asymptot- 
ically stable if max^^^e ^ ^ hand, a vertex is unstable 

■ r r? -^ AtuJinX*-\-Atai] ^ -i 

%j max^^ie ^ ^ > 1 . 


4 . For random-order updating, when k = 1, a vertex is asymptotieally stable if 


l-2x* 


max, 


n -1 AtuJijX*-\-Atai\ ^ ^ 

. e ‘'d 3 <C 1 


Lemma Theorem O, Remark ^ and Theorem |5.4| can be proved as the same procedures 
of Lemma p.l| , Theorem p.3|, Remark |3.1| and Theorem p.4| . Actually, by replacing XtW and 
Xtl in eqn. (^91) with W and / in eqn.(|^) and further letting Jq = Eq in eqn.(^, eqn.(|) coincides 
with eqn.(^). Therefore, all of theoretical results in this section can be proven as the same 
procedure of section 3, only by taking these correspondences into consideration. 

Theorems |5.3[ - |5.5| are useful for both designs of neural networks and applications of DRNN 
to practical problems, e.g., optimization or associative memory, because they indicate which 
local minimum of Lyapunov function is a attractor and which one is not. In addition, the 
bifurcations of DRNN can also be analysed similarly as like Lemma |3.2| and Theorems |3.6|,p^ 


of TCNN. Actually, Lemma p.2|. Theorem p.6|. Theorem |3j. Remark and Remark |3.6| also 
hold for DRNN or eqn. (|8^) if we use / defined in eqn.(|9l|) instead of / defined in eqn.(^. 
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Remark 5.8 

for DRNN or 


Lemma Theorem p7q , Theorem Remark and Remark \3.(\ also hold 
eqn.(^^, where f is defined in eqn. (^). 
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6 Chaos in Discrete-time Recurrent Neural Networks 


In this section, one theorem for a fixed point with sufficiently large difference times is firstly 
addressed, and then our main theorem for chaos is described in the last of this section. The 


function / is defined in eqn.(^). All the theorems in this section can be proved by similar 
arguments as in section 4. 


6.1 Fixed point in DRNN 

First, we show that eqn.(^) possesses a fixed point for sufficiently large At. 

Theorem 6.1 Assume the following two conditions. 

1. W is invertible and Ei > —W~^I > Eq. 

2. 0 < fv < do/ At , where do (> 0) is an arbitrary bounded number. 

Then there exists a positive constant cis such that for any At > cis the discrete-time system 
of eqn. has one fixed point Y* which is bounded. Furthermore Y* is a unique fixed point if 
At is sufficiently large, and Y^ = liniAt^oo 


Proof of Theorem |6.1|. This Theorem can be proved by a similar procedure as in the 


proof of Theorem [4.1| . □ 

Since fxx oc —AtW if At is sufficiently large, we have the following remark. 


Remark 6.1 Y* or X{Y*) is a unique maximum, saddle point or minimum of f defined in 
eqn. o if W is (semi-) positive definite, indefinite or (semi-) negative definite, when At is 
sufficiently large. 

6.2 Existence of chaos in DRNN 


Next, we establish a principal theorem of this section. 


Theorem 6.2 Assume the same conditions as Theorem \6. 4 and 


1. k{Ei + W-^I) > -W-^I; I > Eo, 
or 


2 . / < Eo,0 > /c > -1, 


or 
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3. kW-H < -{W-H + El), WEi + I <Eq, 
or 

4- WEi + I > Eo,0 > k > -1. 

then there exists a positive constant cu such that for any At > cu the discrete-time system 


of eqn. ( ^) is chaotic in the sense of Marotto. 


Lemma 6.1 (Hata, 1982) There exists a positive constant ci^ such all eigenvalues ofDyfiY) 
exceed the unity in norm for all At > Cis and for any bounded Y. 


Proof of Lemma |6.1| . This lemma can be proved by a similar argument as in the proof of 
Hata’s Lemma [0. □ 

Proof of Theorem |6.2|. Dehne [Hi ,as 


[Hi,...,Hnf = W 


-1 


(99) 


For conditions 1 and 2 of Theorem \6.2i . 
Let G = {gi, ...,5'n)^, where, 


HTY*-AtI ^ ^ , 

gi = -r—(-;- Atl — ek 


At 


k 


, -Hfljl+l/k) 

hfh -i , tjT J 


Then dehne 




l+Hl 7(l+l/fc) 

-Hfljl+l/k) 
l+H'ri{l+l/k) 

9 n iT 


In 


( 100 ) 


( 101 ) 


1 - S'! f-9n 

Therefore, XiY^) = G hy eg ns . (18^ , (11001) and (|101|) . The following condition should be 
satished in eqn.( |101|) . 


D< gi<l (* = 1, ..,n) 


( 102 ) 


Note that limAt^ooS'i = ~Hfl{l/k + 1) which is between 0 and 1 ensured by the condition 


1 of Theorem |6.1| and the conditions 1 and 2 of Theorem 
Since, 


F(y°) = -{Y* - Atl) + ke 
k 


In 


91 

1-31 


In-r^ 

i-9n 


Jr -^rhi+i/fc) 
i+r/j'/ii+i/fe) 


'-'G+HTlil+l/k) 


(103) 
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then for sufficiently large At 


F(F°) oc 


Atl 


k 


which is negative because of the conditions 1 and 2. 


For conditions 3 and 4 of Theorem pT : 
Let G = where, 


Hr,Y-'-At(I + WE,) , 

* = - k - 


Then define 


'''A+H'[I(l+l/k)+l/k 


, -Hflil+l/k)-l/k 
'''A+HTl(l+l/k)+l/k 


= e[ln ^ , ■■■, luz 


1 - S'! 1 - 5'n 

Therefore, X{Y^) = G. The following condition should be satisfied in eqn. 


(104) 


(105) 


(106) 


0 < gi < 1 (i = 1,n) (107) 

Note that liniAt^ooS'i = ~HjI{l/k + 1) — 1/k which is between 0 and 1 ensured by the 
condition 1 of Theorem El and the conditions 3 and 4 of Theorem |6.2| . 

Since 


1 


F{Y^) = t\^* - At{I + WEi)] + ke 

re 


In 


Cl _ -Hfl{l+l/k)-l/k 
1-91 ^ G+H'[l{l+l/k)+l/k 


/„ 9 n _ /„ -Hfl{l+l/k)-l/k 

”''l-9~ ''"'l+HTl{l+l/k)+l/k J 


(108) 


then for sufficiently large At 


F(F°) oc 


At (I + WEi 
k 


(109) 


which is positive because of the conditions 3 and 4 of Theorem |0. 


Then Theorem |6.2| can be proved as the same procedure as that of proof of Theorem |4.2| . □ 
Obviously, there are two different type of snap-back repellers for Theorem |6.2| . One is 
{yo* (sufficiently negative) E(Y^*) Y*} corresponding to conditions 1 and 2, the 

other is (sufficiently positive) E{Y^*) y*} corresponding to conditions 3 and 4. 


Remark 6.2 Chaos in eqn. is generated not from a saddle point, but from a repeller when 
At is sufficiently large. 
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Remark 6.3 When At is sufficiently large, eqn. can generate chaotic behaviour even if the 
system is symmetry without self-feedback weights, i.e., W = and uja = 0;i = 1, 


Theorem 6.3 Y{f) of eqn. is bounded for any initial value T(0) if —1 < k <1. 


Example 6.1 Consider a one-dimensional case of eqn. 

yit + 1) = (1 - fiAt)y{t) + At{ujx{y{t)) + a) ; x{y{t)) = 

Let R = l;uj = —l;e = 1/250; a = 0.4. Figure shows the output of neuron and the 
maximum Lyapunov exponent with increasing At. 


Analogously to Example 4.1, we first use the condition 2 of Theorem 5.1 or Theorem 5.2 


to estimate the stability of this example. According to the condition 2 of Theorem |5.2|, the 
estimated value of At is At^ = = 0.03101, below which the system can be ensured to 

be stable. If At < 0.03101, the system is stable and converges to a fixed point, which is 
verihed by the numerical simulation in Figure Since the Theorem |5.1| and Theorem are 


conservative although they are easy to use, next we apply Theorem to exactly evaluate 
locally asymptotical stability of this example. 

The hxed point satishes 


fiduz 


x{t) 


+ ujx(t) + a = 0, 


1 — x{t) 

independent of At. 

According Theorem ^.4|, the condition under which the fixed point is stable is as follows 


( 110 ) 


k H- ujx{t)[l — x{t)) > —1, 


( 111 ) 


because we only analyse the performances for k > 0. Therefore, by solving eqns.(|110|) and 


(| 1 1 1 |) , we obtain the critical values of At and hxed point x*, 


AC = 0.032744; = 0.401595. 

Therefore, If At < 0.032744, the system is stable and converges to a hxed point; at At = 
0.032744, the hxed point bifurcates into 2-periodic points; when At > 0.032744, the system 
becomes unstable. These facts are verihed by the numerical simulation in Figure |^. 
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Finally, we use the condition 1 of Theorem Q^to analyze chaotic dynamics of this example. 
According to the condition 1 of Theorem p.2| , there exists chaotic behavior when At is sufficiently 
large. Actually, in this example, when At > 0.09536, the chaotic behavior appears, which is 
numerically verihed by positive maximum Lyapunov exponents in Figure although there also 
exist many periodic windows. 

Example 6.2 Consider a two-dimensional case of eqn. Let /x = = — l;a ;22 = 

—2;a;i2 = —0.5;a;2i = —0.5;e = l/250;ai = 02 = 0.2. Figures and ^ show the outputs of 
neurons and the maximum Lyapunov exponent with increasing At. 

Since the minimal and maximal eigenvalues of W are Xmin = X^ax = the 

condition 2 of Theorem ^.1| or Theorem ^.2| can be used to analyse asymptotical stability for 


At < f = 0.67. 


For the synchronous updating: According to the condition 2 of Theorem 5.1, the estimated 


value of At is Atp = 


8e 


= 0.01429, below which the system can be ensured stable. 


8e/i. ^min 

Actually, as shown in Figure H, when At < 0.0416, the system is stable and converges to a 
fixed point. Next, we use Theorem O to analyses local stability of this example in more exact 
manner. The fixed point satisfies 


X'itX A 

hdn ^ uJijXj{t) + Oi = 0, (t = 1, 2) 

t Xi\t) 


( 112 ) 


independent of At. The hxed point is X* = = (0.175392,0.0615991) by solving 

eqns. (|112| ). According to the condition 1 of Theorem |5.4|, the condition under which the hxed 
point is stable follows 


l_^At + ^^^ >-1, and l-/iAt+^^^ < 1, (113) 

where eigenvalues of diag[x\{l—x \),..., x* (1—x* )]hF are calculated to be X'^^^ = —0.17827; X'^^^ = 
—0.08230. Therefore, by solving eqns. we obtain the critical values of At, 


AC = 0.04381. 

If At < 0.04381, the system is stable and converges to a hxed point; at At = 0.04381, the 
hxed point bifurcates into 2-periodic points; when At > 0.04381, the system becomes unstable. 
These facts are verihed by the numerical simulation in Figure 
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For the asynchronous updating: Here, we use cyclic updating for simulation. According 
to the condition 2 of Theorem |5.2| , the estimated value of At is Ate = sei^-u- ~ 0.01575, 
below which the system can be ensured to be stable. Actually, as shown in Figure H, when 
At < 0.01575, the system is stable and converges to a hxed point. Next, we use Theorem to 
analyse stability of this example in more exact manner. Since the fixed point is independent of 
At and updating schemes, the hxed point is X* = (x^, X 2 ) = (0.175392, 0.0615991) calculated in 
eqns. (|112| ). According to the condition 2 of Theorem |5.4| , the sufficient condition under which 
the hxed point is locally stable follows 


1 — fiAt + 


Atu. 


II * 


-x’)> -1, for ! = 1,2, 


(114) 


because of /i > 0 and ooa < 0. Therefore, by solving eqns. (|114|) , we obtain. 


At, = 0.053825. 

If At < 0.053825, the system is stable and converges to a hxed point. When At > 0.0582, 
the system becomes unstable, as shown by the numerical simulation in Figure ^ 

On the other hand, according to the condition 1 of Theorem |6.2| , there exists chaotic behavior 
when At is sufficiently large. Actually, in this example, when At > 0.06066 (for synchronous 
updating) or At > 0.06915 (for asynchronous updating), the chaotic behavior appears, which 
is numerically verihed by positive maximum Lyapunov exponents in Figures ^ and 
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7 Conclusion 

This paper theoretically proved that both TCNN and difference equations of discrete-time recur¬ 
rent neural networks (DRNN) have chaotic structure by applying Marotto’ Theorem, and gave 
sufficient conditions for existence of both a fixed point and chaotic behavior. A significant char¬ 
acteristic of TCNN and DRNN is that they have only one fixed point which generates chaotic 
behaviour of neural networks when the absolute value of self-feedback connection weights in 
TCNN and the difference time in DRNN are sufficiently large. Besides, this paper also in¬ 
vestigated the relations between the asymptotically stable points and the minimal solutions 
of the Lyapunov function, and derived the conditions for which both TCNN and DRNN can 
asymptotically converge to a fixed point, which ensure the convergence of chaotic simulated 
annealing^ These convergent theorems are also useful for applications of TCNN and DRNN 
to practical problems, e.g., optimization and associative memory, because they indicate which 
local minimum of Lyapunov function is an attractor and which one is not. The local bifurca¬ 
tions were also investigated to show the bifurcation process for chaotic simulated annealing . 
Since the models which we used in this paper are simple and general, the obtained theoretical 
results hold for a wide class of discrete-time neural networks. 
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APPENDICES 


A Urabe’s Proposition (1965) 

Let F : BF —> BF be a continuously differentiable function in some region If C BF. Assume 
that equation 


FiY) = 0 

has an approximate solution Y = Y for which det{FY{Y)) is not zero, and there is a constant 
e (> 0) and a constant p (> 0) such that 

1. a = {F|||F-F|| 

2. \\Fy{Y) - Fy{Y)\\ < p/d for any Y C a, 

3. < e, 

where r and d (> 0) are positive numbers such that ||F(F)|| < r and ||Fy(F)-i <d. 

Then F{X) = 0 has one and only one solution Y = Y* m. and \\Y — 


B Gerschgorin’s Theorem 

Consider a matrix W 


W 


UJii • 

■ ■ ^In 

^nl 

^nn 


(115) 


Let Ap G C;{p = 1,n) be eigenvalues of W, and 9i = uu] ri = ii = 1, •••, n). 

Then Ap G UILi BiOp r*); {p = 1, n). In other words, there exists a set Sq C {1,..., n} such 
that the following inequalities hold for some i E So. 
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Ti > \9i - Apl for p = 1, ...,n 


(116) 


C Some Facts for Matrices 


A matrix W and two diagonal matrices K, Z are defined as, 


1^11 • ■ • ^In 

W = : : : ; K = diag{ku,knn) ] Z = diag{zu,Znn), (117) 

^nl ‘ ' ' ^nn 

where Zu >0 for f = 1, Define a diagonal matrix a/Z = diag{^/zii, 


Lemma C.l The matrix K + ZW has the same eigenvalues as those of the matrix K + 
y/ZW^. 


Proof of Lemma |C.l . 

Since Zj* > 0 for i = 1,n, it is easy to show that algebraic eqnation det{K+ZW — \ 1) = 
0 for A is identical to det{K + y/ZWyfZ — A 1) = 0, which means that K + ZW and 
K + \fZWyfZ have the same eigenvalnes. □ 

Then following results hold. 

Theorem C.l Assume W is a symmetrical matrix, i.e., W = , and ku, zu are real numbers. 

Then the following results hold. 

1. The matrix K + ZW has the same eigenvalues as those of the matrix K + yfZWyfZ. All 
of these eigenvalues are real numbers. 

2. Let Zu > 0 for i = 1, ...,n. Then properties of matrix a/Z1Ta/Z are identical to those of 
W in terms of positive definite (or semi-positive definite), indefinite and negative definite 
(or semi-negative definite). All eigenvalues for yfZWyfZ (or ZW) are real numbers. 

3. Let Zu > 0 for i = l,...,n. Then all eigenvalues of ZW is positive (or semi-positive), 
if and only if W is postive definite (or semi-positive definite). All eigenvalues of ZW is 
negative (or semi-negative), if and only ifW is negative definite (or semi-negative definite). 
Furthermore, ZW has both positive and negative eigenvalues, if and only ifW is indefinite. 
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Proof of Theorem |C.l 

For condition 1. 

According to Lemma |C.1| , K + ZW and K + \fZW\rz have the same eigenvalues. Since 
K + \fZW\fZ is a symmetrical matrix due to IT^ = W, all eigenvalues oi K + \fZW\/Z as 
well as K + ZW are real numbers. 

For condition 2. 

Dehne a principal submatrix Wi of W as, 


W, = 


Uii ■ ■ ■ Uii 


U)i\ * * * 


Let A = \fZW\fZ^ then 


for i = 1,..., n. 


(118) 


Ai = \fZiWi\fZi (i = l, ...,n), 


where yfZi and Aj are submatrices of \fZ and A defined as the same as Wi, respectively. Note 
that different from an asymmetrical matrix ZW, \fZWyfZ or A is a symmetrical matrix. 

Let us hrst show that W is positive dehnite if A = a/ZITa/Z > 0. The necessary and 
sufficient conditions for which A is positive dehnite are 


det{Ai) = det{'/Zi)det{Wi)det{'/Zi) >0 {i = l,...,n). 

Since Za > 0 for i which means that a/Z is positive dehnite, det{'/Zi) > 0 for 

i = I, Therefore, to ensure det{\/Zi)det{Wi)det{\/Zi) > 0 for i = 1, ...,n, the inequalities 
det{Wi) > 0 for i = 1, ...,n must hold, which means that W must be positive dehnite. 

On the other hand, if W >0, then det(\/Zi)det(Wi)det(\/Zi) > 0 for z = l,...,n, which 
means that A = \^W^/Z is also positive dehnite. Therefore, the positive dehniteness of 
\fZW\fZ is identical to that of W. 

As the same way, we can prove the cases for semi-positive dehnite, indehnite, negative 
dehnite and semi-negative dehnite. 

For condition 3. Let ka = 0 for z = 1,..., n in condition 1, then from the conditions 1 and 2, 
the proof of condition 3 is straightforward. □ 
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Captions of Figure and Table 


• Figure ^ : Output of the neuron and the Lyapunov exponent in the single neuron dynamics 
of TCNN with increasing |a;|. k = 0.9; e = 1/250; a = 0; oq = 0.65. (a) Output of neuron 
and (b) Lyapunov exponent. 

• Figure ^ : Output of the neuron and the Lyapunov exponent in the single neuron dynamics 
of DRNN with increasing Af. /i = l;a; = —l;e = 1/250; a = 0.4. (a) Output of neuron 
and (b) Lyapunov exponent. 

• Figure ^ : Outputs of the neurons and the maximum Lyapunov exponent in two-neuron 
dynamics of DRNN with synchronous updating, /i = l;a;ii = —l;a ;22 = —2;a;i2 = 
—0.5;a;2i = —0.5;e = 1/250; oi = 02 = 0.2. (a) Outputs of neurons and (b) Maximum 
Lyapunov exponent. 

• Figure § : Outputs of the neurons and the maximum Lyapunov exponent in two-neuron 
dynamics of DRNN with asynchronous updating, fi = l;a;ii = —l;a ;22 = —2;a;i2 = 
—0.5;a;2i = —0.5;e = 1/250; ai = 02 = 0.2. (a) Outputs of neurons and (b) Maximum 
Lyapunov exponent. 
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Figure 1: Output of neuron and the Lyapunov exponent in the single neuron dynamics of TCNN with increasing 
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Figure 2: Output of neuron and the Lyapunov exponent in the single neuron dynamics of DRNN with increasing 
At 
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Figure 3: Outputs of neurons and the maximum Lyapunov exponent in two-neuron dynamics of DRNN with 
synchronous updating 
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Figure 4: Outputs of neurons and the maximum Lyapunov exponent in two-neuron dynamics of DRNN with 
asynchronous updating 



